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Abstract A genetic algorithm based robust blind digital watermarking scheme 
is presented. Starting from a binary image (the original watermark), a genetic 
algorithm is performed searching for a permutation of this image which is as 
uncorrelated as possible to the original watermark. The output of the GA is 
used as our final watermark, so that both security and robustness in the water- 
marking process is improved. Now, the original cover image is partitioned into 
non-overlapped square blocks (depending on the size of the watermark image) . 
Then a (possibly extended) Hadamard transform is applied to these blocks, so 
that one bit information from the watermark image is embedded in each block 
by modifying the relationship of two coefficients in the transformed matrices. 
The watermarked image is finally obtained by simply performing the inverse 
(extended) Hadamard transform on the modified matrices. The experimental 
results show that our scheme keeps invisibility, security and robustness more 
likely than other proposals in the literature, thanks to the GA pretreatment. 
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1 Introduction 

Digital watermarking concerns those methods about how to hide a special 
mark into digital multimedia data to solve the problems of legal ownership, 
integrity and authenticity of the original data [2]. 

The techniques proposed so far can be grouped into two different ap- 
proaches, depending on whether the watermark is embedded into the least 
significant bits (spatial domain approach, [9 ) or it is embedded attending to 
the perceptually most significant frequency components of the container image 
(frequency domain approach, pQ). Usually one tends to apply techniques of the 
second type, since spatial domain approaches have relatively low information 
hiding capacity and, what is more important, can be easily erased by lossy 
image compression. 

Most of frequency domain approaches use discrete wavelet transform (DWT), 
discrete Fourier transform (DFT) and discrete cosine transform (DCT). Very 
recently fast Hadamard transform (FHT) has arised as a promising alterna- 
tive (see [5] and |12] for instance). Interested readers in Hadamard matrices 
(square matrices consisting in pairwise orthogonal rows) are referred to [B] . 

No matter the processing speed is, watermarking is usually required to 
muster three conditions: security, imperceptibility and robustness. 

Security is concerned with embedding a watermark into a piece of con- 
tent at an untrusted user device without compromising the security of the 
watermark key, the watermark or the original (see |? for instance). 

Perceptibility measures whether perceptible artifacts on the watermarked 
image are introduced, that is, if the presence of the watermark in the final 
image is noticeable. This magnitude is measured in terms of the Peak Signal 
to Noise Ratio, or PSNR in brief. It is most easily defined via the mean squared 
error (MSE), so that for images with maximum possible pixel value range 
(i.e. 255 or I depending on whether byte or real storing method is adopted), 
PSNR is calculated as: 

PSNR= 10 log 10 ^^. (1) 

Here, for two m x n monochrome images K = (kij) and L = (hj) (where 
one of the images is considered a noisy approximation of the other) , M SE is 
defined as follows: 



1 m — 1 n — 1 

MSE= V V •:/.',., I,.,)- 

mn *-^> 



i=0 j=0 



The robustness of a watermark depends on whether it fails to be detected 
after unintentional or even malicious transformations (see (10) for details). It 
is usually measured in terms of the Normalized Correlation (NC) between 
the extracted watermark image EW = (ew^j) (presumably modified) and the 
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original watermark W = (wi.j), 



m — 1 n — 1 



EE 



NCw,ew 



i=0 j=0 



(2) 



m— 1 n— 1 



m — 1 n— 1 
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Given a watermarking scheme, it may be straightforwardly improved in 
terms of security, imperceptibility and robustness by simply introducing some 
pretreatment to the watermark image in order to destroy space relativity (see 
[XT] or [12] for instance). 

Taking the work in [12] as starting point, in this paper we describe an 
improved blind (that is, the original cover image is not needed for extracting 
the watermark) watermarking scheme, with the following advantages: 

— There is no dependence on the sizes of the watermark and cover images (in 
[T2] it is forced to be 1/8). 

— The trade-off between imperceptibility and robustness is measured in terms 
of a parameter b. The greater b is, the nearer NC is to 1, the smaller PSNR 
is. Accordingly, the smaller b is, the smaller NC is, the greater PSNR is. 
Some explanations (beyond simple computational evidence!) will be given 
in order to justify the optimal value for b, depending on the way in which 
the image is being stored (real or byte representation). 

— Robustness, security and imperceptibility of the scheme are significantly 
improved thanks to a pretreatment of the watermark image. We have de- 
signed a genetic algorithm (in the sequel, GA in brief), looking for a per- 
mutation of the original watermark which is as uncorrelated as possible to 
it. This GA, equipped with a specific crossover operator specially designed 
for the occasion, beats usual GA equipped with classical crossover opera- 
tors concerning permutations problems (such as order 1, partially mapped 
and cycle crossovers, or edge recombination). 

We organize the paper as follows. Section 1 is devoted to introduce the 
problem of watermarking, and our proposal. The GA looking for permuted 
images of the watermark with low correlation is described in Section 2. Sec- 
tion 3 is devoted to explain the watermarking scheme. Some executions and 
examples are showed in Section 4. We include a last section for conclusions 
and comments. 

2 GA for uncorrelated permuted images 

Given an image Im, we want to find a permuted image PIm of Im, so that 
their normalized correlation NC(Im, PIm) is as less as possible. The key 
problem here is establishing a method for looking for permutations of the 
watermark as uncorrelated as possible. Since one cannot afford to perform an 
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exhaustive search in the full set of permutations, we are dealing with a problem 
worth of some kind of heuristic solution. 

Permutation encoded problems are often used to represent scheduling prob- 
lems and classic combinatorial optimization problems, such as the Traveling 
Salesman Problem, Bin Packing or Job Scheduling, to name some. Here, the 
goal consists in (or can be solved by) arranging some objects in a certain order. 

These optimization problems can seldom be solved by using exhaustive 
searches, due to the large size of the search space. Some kind of heuristic is 
required instead. For instance, GAs. 

In what follows, we assume that the reader is familiar with the general 
framework of GAs, and their usual elements and characteristics. If necessary, 
[3] (and the references there included) is a good place to get a general overview 
of the subject. 

The GAs which deal with permutations are known as ordering GAs or 
simply order-based GAs. 

Although GAs are widely recognized as powerful and widely applicable 
optimization methods for string encoded problems, there is no standard GA 
for manipulating ordered-list representations. However, several crossover op- 
erators and mutations have been suggested in the literature, including Order 
Crossover (OA), Partially Mapped Crossover (PMX), Cycle Crossover (CX), 
Edge Recombination (ER), Insert Mutation (InsM), Swap Mutation (SwM), 
Inversion Mutation (InvM) or Scramble Mutation (ScM), for instance. The 
interested reader is referred to [3J and [5] for details and further bibliography. 

Here we use a Steady-State GA, in the sense that three offspring (two 
coming from crossover, and one more coming from mutation) are generated per 
generation, which will replace the worst adapted individuals at the moment. 
This way, we use also elitism, since we always keep the fittest solution so 
far. Additionally, we use a "no duplicates" policy, in the sense that identical 
individuals are not allowed to occur in the same generation. 

In order to select two individuals for reproduction purposes, we use rank- 
based selection, by means of linear ranking. More concretely, assume that the 
size of the population is fi. Then sort the population in terms of fitness, so that 
fittest has rank fj, and worst rank 1. Now fix a factor 1 < s < 2 (we use s = 1.5 
in the sequel). In this circumstances, the probability that the i th individual is 
selected for reproduction is given by 

2-, ^-1)0,-1) 
H MM- 1 ) 

Depending on whether the factor s is closer to 1, fitness is accordingly rela- 
tivized for choosing the individual. 

Our population consists of 20 individuals, and every run is limited to 50 
generations. The fitness function consists in the normalized correlation ^ 
between the permuted image and the original watermark, so that the lesser 
NC is, the fitter an individual is. 
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Although defining crossover operators for permutation encoding is a dim- 
cult task, nevertheless, we have designed a new crossover operator (which we 
denote simply by X), attending to the characteristics of our problem. 

Since our watermark images are binary (just black (=0) and white (=1) 
pixels) to x to matrices, we can easily encode them as TO 2 -length binary vectors. 
Furthermore, we can just save the positions in which 1 (analogously, 0) entries 
are displayed. Assume that the watermark image consists of k white pixels. 
Then the set of its permuted images is uniquely determined by the set of 
fc-subsets of {1, . . . , to 2 }. 

Given two such different fc-subsets S\ and S2, we select proportionally 
positions in S\ and 5*2 attending to their fitness. Assume that S% has better 
fitness than 62. Fix randomly a real number 0.5 < r < 1. Then we will get a 
\k ■ r\ -subset S of Si , and join this subset with a random k — \k ■ r\ -subset of 
S 2 -S. 

A priori, there is no evidence of which among the crossover operations cited 
above is more suitable for our purposes. 

The comparison in Table [2] suggests that our proposed crossover operation 
X is more successful than traditional ordering crossovers OX, PMX, CX and 
ER. 

Due to the binary character of the watermarks, we have chosen two im- 
ages with significantly different density of white pixels (the FA MA logo of the 
University of Seville and the common Stop driving signal, see Table [5]). 




Table 1 FA MA and STOP watermarks. 



For each of these images, we have performed 10 runs for each crossover 
and mutation operators, each of which consisted of 50 generations. The size of 
every population is fixed in 20 individuals. In the table below, NCi denotes the 
best NC value at generation i, Avi denotes the average of NCi values along 
the 10 runs, and iter denotes the average of the generation in which fittest 
NC50 was found along the 10 runs. The optimal values for NC found so far 
are written in bold. They have been obtained performing a GA consisting of 
our proposed crossover operator X and the Inverse Mutation operator. 

Notice that there is no interest in timing considerations here, since this is a 
preprocessing step in our watermarking scheme. Anyway, it is noticeable that 
every run is performed in just a few seconds. 

From Table [5] above we conclude that our GA looking for a minimally 
correlated permuted image is successful, in the sense that normalized correla- 
tions of random permuted images (forming the initial populations) are always 
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43 
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0.8045 
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0.1806 
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48 
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39 
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45 
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0.8072 
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Table 2 GA applied to FAMA and STOP. 



greater than the local optimum found by the GA, no matter the crossover 
operator has been selected. Moreover, the crossover X seems to provide fitter 
permuted images than usual ordering crossovers. 

In the following section we describe a watermarking scheme. We claim that 
pretreatment of the original watermark (so that a minimally correlated per- 
muted image is obtained and used instead) , improves the watermarking scheme 
in an obvious way, not only from the security point of view (no matter one 
knows the extracting procedure, the extracted watermark will be meaning- 
less), but sometimes (depending on the concrete image, compare Tables 4 and 
6 below) also from the point of view of invisibility, without loose of robustness. 



3 The watermarking scheme 

Grayscale digital images may be stored both in real (the real values of the 
pixels moving from 0=black to l=white) or byte (the integer values of the 
pixels moving from 0=black to 255=white) encoding. Nevertheless, usually 
byte encoding is preferred, since not every computational system can support 
working with real encoding (and it requires a discretization step) . We will work 
here with byte encoding, unless stated otherwise. 

Let A be the original cover grayscale digital image, encoded as a n x n 
matrix with integer entries in {0, . . . , 255}. 
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Let W be the binary watermark, encoded as a m x m matrix with 0, 1 
entries. 



3.1 Watermarking embedding 

The embedding procedure may be detailed as follows: 

Ti 

— Find a normalized Hadamard matrix H of size At closest to I — I . 

m 

Tl 

— Partition the original image A into non-overlapped blocks of size I — J . 

m 

Consider the sub-blocks of size At x At naturally embedded, which we denote 
by A, 1 < i < m 2 . 

— Apply the extended Hadamard Transform to Ai, in order to obtain 

Bi = EMI (4) 
At V ' 

— Select two entries b\ and bi in Bi in the same row (or column), say 
b\ = i?i(3,3) and 62 = -Bi(3,5) for instance. Depending on whether the 
corresponding pixel i in W is or 1, force that bi > b± or bi < b\ accord- 

I&1-&2I 

ingly. To this end, fix a value b, and take d = . Then set: 

— If i = and &2 < b\ then actualize b\ = 61 — d — b, b\ = 62 + d + b. 

— If i = 1 and &2 > b\ then actualize b\ = b\ + d + b, b^ = &2 — d — b. 

— The watermarked block A* is obtained by the inverse transform of (@|, 

a: = (5) 

At this point, we would like to make two major comments: 

1. Taking a deeper insight in the Hadamard transform Q one deduces that 

zi B* H 

a change A in b; translates into a change about [ — 1 in A* = — . 

& l 2t l 1 At 

Hence, in order to get noticeable byte changes, we should take b » t. In 
the case of real encoded images, b may be chosen arbitrarily small (at the 
risk of decreasing the normalized correlation of the extracted watermark) . 

2. Although the Hadamard Conjecture about the existence of these matrices 
in every order At remains open, there are well known families of Hadamard 
matrices filling an infinite amount of sizes At (see [6] for details, and [4] for 
a computer aided generation of Hadamard matrices) . 



3.2 Watermarking extraction 

The extraction procedure is just the inverse procedure of embedding. 

Let A* be the i'^-block of the watermarked image. In order to recover the 
pixel i of the watermark one must simply proceed as follows: 
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FT A* 

By ©, form B* = ± . 

Let b\ and 62 be the entries used in the embedding procedure. If 62 > h\ 
set i = 0, and i = 1 otherwise. 



4 Experimental results 

We have used 5 different 512 x 512 cover images (see Table 3), and two different 
64 x 64 watermarks (see Table 1). We have fixed H to be the 8x8 Sylvester 
Hadamard matrix, 



H = 
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Table 4 shows the PSNR and NC values obtained for different values of 
the parameter b. 



Table 5 shows that the proposed watermarking scheme is robust under 
different attacks, such as jpeg compression (with quality factors 80% and 90%), 
Gaussian noise (of mean and variance 0.001) and salt-and-pepper noise (of 
density 0.01). 



GA based robust blind digital watermarking 



9 







Lena 


Baboon 


Boats 




b 


PSNR 


NC 


W* 


PSNR 


NC 


W* 


PSNR 


NC 


W* 




2.01 


47.1796 


1 




40.3194 


1 




46.4154 


1 






2 


47.2432 


1 




40.34 


1 


(in 


46.4493 


1 


(in 




1.99 


47.3031 


0.9976 


1 1 Jf ; 


40.3604 


0.9989 




46.4827 


0.9982 


ilar'5 

U*. 




2.01 


47.256 


1 


m 


40.1841 


1 


IBi 


46.4054 


1 


Hi 


111 


2 


47.2988 


1 


ill 


40.2034 


1 


IIP 


46.431 


1 


111 




1.99 


47.3414 


0.9586 


list 


40.2238 


0.9676 




46.457 


0.9696 









Peppers 


Testlena 




b 


PSNR 


NC 


W* 


PSNR 


NC 


W* 




2.01 


47.256 


1 




38.0736 


1 






2 


48.5626 


1 




38.1818 


0.9711 






1.99 


48.6202 


0.9982 


1ST) 


38.3227 


0.9191 


■1 


III 


2.01 


48.2392 


1 


ill 


42.7214 


1 


mi 


2 


48.3059 


1 




43.0388 


0.6448 


ml 




1.99 


48.3734 


0.9480 


Ens 


43.3333 


0.4993 


% 



Table 4 PSJVP and JVC in terms of b. 
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Table 5 PS7V.R and 



JVC under noises. 
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Table 6 PSNR and JVC using GA-watermarks. 



Although the proposed watermarking scheme works fine without any need 
of pretreatment of the watermark, we want to emphasize that permuting the 
initial watermark ensures that security and imperceptibility (and even robust- 
ness to a somewhat lesser degree) are enhanced. 

Table 6 below shows computational evidence of this fact, when we substi- 
tute the original watermark W by the permuted images PW provided by the 
GA described in the previous section (those corresponding to the bold entries 
in Table 2). 



5 Conclusions 

In this paper we have described a new blind watermarking scheme. We have 
shown that pretreatment of the original watermark so that a minimally corre- 
lated permuted image is obtained and used instead, improves the watermarking 
scheme not only from the security point of view, but also from the point of 
view of imperceptibility, without loose of robustness (see Table 6). 

Although the problem of finding a minimally correlated permuted image 
from the given watermark is hard, we have designed an order-based Steady- 
State GA which successfully solve the problem. It includes a proper crossover 
operator, specifically developed attending to the particular features of our 
problem. This crossover operator has been shown to beat classical order crossover 
operators experimentally (see Table 2). 
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